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#5*8*3 302 2 36f 



[fMfl7] Sife£;h<fc'V9^i®iSi^IIitfe7*— * 10 

*fiMaaa«riHkSii*fc*fl+« r t t-r sit* 

-&^7^-^^ta-r5-^ ftfcsisififc. jamais 
ipi6fa©tfw 9-vHHfe<affr££ft> 

[f&**K9] ^»«fcj:««*»»«>*"n*fclliflE 20 
^tfW 9^ii4Mi;b^«wHftt^j**fl«&glfH'3 r 

[|8W<of¥*fflfttft93] 
[0 0 0 1] 

[0 0 0 2] 

[0 0 0 3] #Nw, m^^WsVTtt, B5R»<0^ 
ftfclHfel- toT/V 9^®&'£'/&£»frli> 7-f KfclE 

[0004] fcfe*>, a»a>S'V 7?Itt-^M)lf 
*J LT 7 W KT?«»«feKlC«« Lfc. 9 i" 3 r b KJt& «r 50 



[ 0 0 0 5 J ±IE/ V 9-»-H**ria«*«:*WI Lfcft* 
y^(Ml-e*S»^«rj!.ortS»lfi:Atta*gki:» fill 

«fc «k 0 IK tb 9 * — * »cas-3.v^-ca*«>»ift«r 

titer— $ b nm&rf—txom&r-* tf%&i£i%Z>o * 

-tux, Sf*^?*^^ 

[0 0 0 6] 

5fc<o/<y 9-^®&-&J#3£Stci3V->-Cl4, Hl)tS»J*:.^t6ttl 

S®-rs t -»^toS»cSB#HSr^i- 5 1 1/> 5 Ran 
[0 00 7] *3£W»4r. i 9 <traffl.**-«*-J5: 

[0 0 0 8] 

«fc/<9 ^ - i^s-^v •>xm&*'&f$.i-z^&$m^m b 

Sr*L, ®^<0— /<— 9 s'7*LTV»S«Sfe<01i 
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[0009] at*^2iaK<o?8^tt, iiMie 

TVS. 

[0 0 10] £ lft3j89(31BttmlBHl2x it#Igl 
fafcOJMmcJaVT, WE/*?*— J*tfe 

[0 0 11] *fc, »#JH4tE*W>38Wl;*, f**^lfE 
Sic J: 5 ®|fe»SJ;M&T Lfct^C^T^HSi*!:, 

M4ttHitttinR«lsmi-CJb« w k **ffi»k LTVS5. 
[0 0 12] 1t#K6Ett«>*K91ld, ®ttO-«B 

5 v 7 b T V ^ttftoBffc U T 1 tfeO 

®te&ffr^aytfc<^/S/<9*-*&£aLfct£, tt 

[0 0 13] tS#*g7ffi*W>3£?l3hi, IS*^6IE 

-^«:^SSIt*»fefll»tBBB«te<Eai^a»fr. sins 

tfc<^/£M3£®&?f£B#K3WTi-5 r £ Srtmt LT 
[00 14] lt*^8IE«<755g^|^ fS*^6 

[0 0 15] 4fc, It*^9l5®0^^»i, »*II6IE 
ZZk&ftWkL, »*K1 0 flatten tt. f**^9 



(3) ^g3302236f 
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[0 0 16] 

[ o o 1 7 ] a i tt*»wi£**'V v-vrnte-smm. 

^=vf a -# (bit, Wya^j 2^«IR 

10 SiXTV-S,, ^y = >2W\ ©te^-^^ 

/T^jf^^7'K4t > 5 £r 41 

>7"^ y^f^^tLTWv^^. 6 k, *r—tf— F 

t»^-Kf^^{> (hd) 9*ss«^$i^T^^So 

[00181.12 tt^V 7-v@itfe-&J5£SS<7?v'^7 1 Afl| 

o s i o s.T/r y y ^r— s^ll li^S*-^ CTCP 

[0019] OSlOli, Mr&ttilzii, a-fw#a\ 
^Srgtt^SA^J^W^^rS^^Al 2 <k, t'-C^ 

A14tS:fx.-CV^. 

[0020] ryy^— >gviiii, itr- 

30 2?fl^rA 1 5 i^V7-viifi!^^fA 16t 
[00 2 1] Ifer-^fl^rA i 5 li, ^^Wlc 

- mz'gm-tzr-f'tm^&i 7 k, ztvbm&r 

5. ^V ^-vMtliM^T'Ai 6li, »»B 

te^-^^<75*f^<l:ttai-r*^.^til^l 9 

40 fiZm&-tZ><&l$/<7*-?niii^&2 0k. Htrl5-&fi£ 
yV7^U&&J&*§-f3®<fc-£/£#!8:2 1 tSriixT^ 

[0022] o s 

1 OroA^f/W^fl^fA 1 2*S, ^r— hV 
>^-7s-^2 2Sr^Lt+-!i<- K7*»t><OA^JSr 
Stt^U, ^VMi-^^^'f 7*— *2 3Sr^-Lt 
!> ^ 6 f> ^ SrS It 51 9 , 5 (C2X*(6]^7 W 
■< >?—y csm >fi—y^—^m<D-&& 

50 X~m&&&*imti:U\M'< sf—y 2 4&ft UTIi 
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***7 1 <onO"CWffc^*— 9 ft 5e '« 

1 6(^s£/<7^-^^aifS2 0"Ci#t>ixfc-g-^'v 
^— ^J?>®tfe^j5fe#a2 1 X"£&£tl1t<&l$.1&%:b LT 
co©^— :?l4tlltex— ^fS-^fAl 5 
•5. -tUT, B«f-^fI^fAl 5\z&m$ix1z 
WSk s f—9\t s f—9^.^WL\ 8^LTO S 1 0<olt 
Ifl^r^ 1 3 K&ibix, f-r^-'f —7 1—^ 10 

T-f^?A 1 4l47 f W^^AtB^ (I/O) -O* 
-7^— *2 6&;frLT^— K^** 9 JrSt^^ 

W&T—9<D&§:$:fti 0 
[0 02 3] 03 lim^-*^ 9 1 Wftjg^ * y K*S#3£ 
ft* HHfev*— i? XtWltev*— 9<r>*f—9 $m ^TrrtmX' 
fe£. 20 

[0 0 2 4] -rftfc>*>, ^rtJa^^y«CI±|2l3 (a) »£ 
jj^TJ; 5 4I*ta7-7'/l' 2 7 #F*3j8£;rV, EHfcN 
o . 1 \Z*H,XW&f— 9 2 8a, mXSrf—9 29a, 
iHfeNo. 2{C*fUTSJ^7 :f — * 2 8 b, Wk^ff—9 2 
9 b £1^5 4 KB^tST 1 — ^ 2 7 l4«&Bjtfe 
<aEHfe##fc»j£LfclBttt7*-- * 2 SRTJWttf*— * 2 
9 4Mfttt$JvCV*£. 

[002 5] Mtfex— ^ 2 8 (-14, m^*^ 9 1 OT34£ 
<07 y Y*r—9 (£1T, ^f^- 7*^— *j £ 
V>5) ^V^IiJPEG (Joint Photographic Codin 30 
g Experts Croup ) ^<D1HM7 *y }>7 i —9 (Oli^T 

IHjWHv^^5*Mt*r*U -*flitfJPE6f-^ 
•5£^5*m«r*LT*i!>, MUMr-CfcfiA^— ri4«# 

®fc-r-*£&*frf3. 40 
[0.0 2 6] Sttx-^2 9KI4, 0 3 (b) 

^^3 0 4, ^?-f7'7 ; -?7*-7y JP 

t5T I FF (Tag Image File Format) &<D{tiL<DifU$ 7 

n — v y hnms^noyr^^f^^s 1 £> a-?-* 

9 lco^-vs/ (^FE^) aMfTSftfci: 
#WBtt&U*##J;4Sfe»$;rv5it^Bll#3 2 £, 

^71 t^-t^mmnm^.^- K*^s«$tvs» 50 



«HfJS3 3 0 2 2 3 6-§- 
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&m<nmgg.*- K3 3#*mAs*iT^5. *lt, 

K3 3 Kfe^£*xfc«l^- Fgtf'V 7vif 
^—KO£#l4H13 (c) »^Tcr«tp(C, SaSU^3 4*s 
^0$H5. -ffc:b*>, OT^iJ-?-3 414, W+Utyl 
A^V 9 -vlft^e- Fairs' h £;rv*L £#!£#£ ft** 
-Kt&S'J^ (WT, r^~KlDj £i^?) 3 5£, 0E 
*— K I D 3 5T-wa^^^B*>Sr^M-«^#-§-3 6 
*VCV5. LfcJiot, /V77i»t-h' 
KioV ">-C 14 ID— <£>■=£■— K I D 3 5 &=r*-.5l£tfe<OIlHfejls 
1-fej/ h-Cfc££i^? w££&5. E13(c:^-r 
W&T—?<n£ b fc'V 9-v*i&^e— FT? filiwjaftj 
#^2ft»BHfcfcLT^S;hrCV^*frli % 11*9* 
— ^ 2 8a CD-=e— h" I D 3 5 a i ®^x— * 28b (Ot 
— K I D 3 5 b t I4P3 — <D I DSr^TL, :il?>Pl-roi 
DJCiO 1 1 y h ^ V 7 vlft^tS 1 1 1 4 

— :? SIM: ^OMtt-T— 9 ftfem $h4, 
[00 2 7] HI4 ItS^*/? 1 OrtiS^ * y 

^XI4#Sb £ 1 1 (O^tr^-T^^ ^ 3" U"< 4 JiW 

[002 8] -Tfc:fc>*>, l?-*^7 1 *5SigE-7-— Zfj^Z 

tem&f—? t gm->*7 L £. i 5 srjgisL, s-^*^ ? 1 

iCftl&ZiXlLT— ^S*tSllW!>-Y^h*!> (W 
T, r^^7^7^n^j il^p) 3 7£, ^— 

^ 9|i*&Sft$iXfC®te7 ? -^'<-^W«^^-nr|g7im2 

W^-Y^ Kl7 r=— -y-'^^nj/j tVNp) 3 8 

[0 0 2 9] LA»UT, ^^9^90^3 7ICI4, ®tfe 
•T— ^ y = > 2 fctoWStRffiHfcSrgcjS 
■T««»<0«^^3 9^tS!«t^H, **WSf#3 9W 
ftSBKI4, MtfeT'-^wJig/h®^ (WT, ^wSB/Jn®^ 

««^eu4 0 ts m&7-?m^W4 1 1 AsgNtfctv, 

m^^t 9 1 tirtSt^tt^BtttT*— 9 2 8 W-tJ-A*— 
M^RXfm,itv i —9 2 9riS/j/f3t<73:g^#3 9rtt-^^ 

ft, JsttT*— 9m.ffm^ naim***? 1 <nft 

1&*=ZV K te^fl $ tltcm^~ 9 <n 0 -§15X14^ 

-f 3--iM4JH47 ? -^<7?5*>, -Pi^li^r 
^5.1^7 r-Y^'f T-tO^SrJSttf'— 9 Wrn 4 1 

<7j Jltt-x- 9 £ Jlte^- ^ ^^ffi 4 1 KSc^-f sa> 

[0 0 3 0] &Wt-, ^7^6Sr^tT3-— -^14^ 
«!=3 9SrilJRU ^A^^-r«t5Ji, illR^^fc®^ 
&:2.—f$9v?'3 8 ±(C^3|fe^«4^»)-rS. f*i, « 
^ (^roi-&lil^*^7 10f*3S>*y 
<75**^$ix5) ^1/^14^®) (r<0^»4^ 
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■tut, -r/,ffc.t,m-f-*>7 Hitesfl^nfcste^-^^ 

§y < y => > 2 K# 9 &tr i # K*-f x -c ^ = f—9 *ffij£ 

KTJH&Sftfc. t # (4, ^EHfcKj£i:TMj£.6ttai4& 

3, **tt«»SrtTV\ 

4±fc&t7frr&. 10 
[0 0 3 1 J WT, me)«?*Q3B*r*flsWJCttWi--6. 
[ 0 0 3 2 J HI 5 liJifEa-— n^3 8 JbT^— 

i^r—zfjVA 2 14, a-— WJIWEa.— IF** d i/3 8 

«>SHkf*— f&WktoW&k l oco^u— :/£ Lt*r 
y fete$MHi-S*MB*r* L, £ Jxlc «fc <3 1 ^ n 20 

^JR-fSlHfeT*— tnf— fWfttf- <cf—5 I D) 4 

•rvtsm- ota — yi d) 4 4 t&ftmzth, 

I D 4 4 14, T'Sttx— ^4 5 t 'J >^ LTV^ 

SllitfeT*— 9<r>*f— 9 I D 4 6 wftfe, i/yu— ^Mtt^— 
^ 4 7 aM&iSftiSnTV'i. yj^-fJB&.'r—fi 4 7 b L 
TI4n-— *f*s-ft«{C#Lfc^U— 7*^,4 8 ifjV—rf 30 

teS^H-S. 4 8 £ LTI4, /V 7-*W&<D 

-fey hi L-T^- 7*Jlsf^fiE^ti.fct# 14^7 ^-/WKT 

014, 3--1f^^Lfct#l4 iFfftfcj , 'V? 
^IJ^-fes' hirLT^/i—^f^fig$Hfci:tl4 W 

a!HF-#4«0S*l*, -ffcfclb, KlffiSUT-3 4 14, 

[0 0 3 3] £P>fC, EtSf-^flyXfAl 5 
14, f-^fIr^5 3*irtS^, EHfe-T-^K 

tti-zm&nmifrx-hZT*—? ids 4 ^#$kt*s 

-?rLT, /V 7^®^0*^I4, =g-x— * I 
D 5 4 14®^ ^71 0>rtJBW * y K*&*ft£;txfcIlHfc-7* 

[0 0 3 4] m6\*'<S7^mfe1^<n$im^M*:7frt 50 



**ff^3 3 0 2 2 3 6-§- 
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i>^y3>-2 Kis&x-* aME&SHfc t t y = 

>2<7>CPU (^EK*) T^T^hS. 
[0 0 3 5] ^yZfS 1-CI4-T— ?*!Si6!»7l.fci s 

5*»«r*l*M-«. ^yy^SlWJWKliAtOttS* (N 
o) ^TyT'S 2 Kit*, HHfex-* 

2 9<7)7r-f A^--f:/3 lKg-3v>T¥iJ$rU i^Tyzf 
S 3) , ^f^7*f- ^Tfc^tttt.T.XS'T'S 5(C 
otti— *f 5V -J^—OXD £ # 14^^ x J -f=r— 
9% J PEGf- 0f*«)iRJl7*r- vs/ 
Lfc^7r-i'>'W^'('7 p 3 lSrHfrU ^•xs/T'SS^it 

[0 0 3 6] 5T-J47*— ^VSt 1 — ^5 3 

lc*S^$^^T^^•5«■l4v ^ — * 2 9 a><b»l^- K3 3 & 

5 0 •tLT r^y^-vHiSu -C<tv>i:#l4a*roiii*-r 
-!?i:LTSSt5. -Tft:b*>, f-^flr-7';i'5 

3 I D 5 4 &ttL-C3£8!:-r-5 t*^^^ 
— I D^^o/f — "ffrA 2{iS®L, (^T's'T'S 
6) , ^7S'7 , S1HI«, 

[003 7] r^-?y (75 1 1 14, *fj£-r 

^SrfJRffL C^s/r/S 7) , ^rO^S#^ (Ye s) 
<Ot#«4^7 i s/y*S 9»cittf-^, -?:W«*S53t (N 

o) wirtli^yu— ■7*iPf$.V1tM (^fs-yss) ^ 
T^s/T'S 9tCiitf, -rftto*,, *?D/f-7'^4 2('5 
oo^e— KID51 (05) ta«far-7*^tf3*- K 

I D 3 5 a t *s m— WSrfij/^tS: t»i J: 

k.tti^/^~rf \T>4 4-&$>9n {f'r—zf^4 2 Kg® 
L, ^7"*4 8, f^fi£B^F4 9, if>V—'79<<-7S 

jJOt— y"5 otctt kismz 

H, IJ^-r— t 3 ©*- K I D 3 5 t ffi—<V I D*5*— 
KlDSlCfeiS^S. tU^fs'T'S 9-?«vV 

^g-^x^S 3(cSgkU ^-r— * I DirlS— ©f- 
^ I DS:^;U- T'JS'ttT 1 — ^4 5(75^—;? ID46C 
S^L, ^fy7"Sll;I5„ 

[0 0 3 8] £i±<0-jS(75MSSr^^-r5±T<7Dlli^ 
7— ^«COV^TtfV\ ^TWMttt-T*— ^JC^LTteS* 5 
J^TLfcirf, -r&fc^T's/T'S lcTD^AS^ ( Ye 
s) t/io^it#l4, *<r?zfS 1 0*CitA/-C, ^*E* 

wrfLZftitA^gfc&mmu *<»&&&fe (No) «7>i 

tl4-ero4iMS^T-rS-*, -t^riS-t^ (Ye 
s) (Ot#»4^u-7'rtw®^Sr^bT«i!Ei-5»Jc£: 

.^ttmtes (*trs/7°s 1 1) su^-^T^-^^m 
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/wB&£ffr£l-T (^fs'/S13) MSfci&Ti-*. 
[0039] 07 (a) ~ (c) l*±tE1>-A*— /U-f^J5£ 

#ysx-38JR $ *v* -!>•.*.*— A^5££^-f 0t? fo *. 

[004 0] 07 (a) |i>»V9-*Bttn?fc*i:V>5- 

!S:££ixT^*Bfc;6M&E£*v*. 0 7 (b) 1*1 -fey 
K<7VV9-?Bttlffl<Z>*>-- 7* (£TF\ W;77^ 
-7*j tv>5) K^£;h.*B&£-?:«o£*3g/hL-ca^ 
i-*t<D-efo*. 07 (c) li-£j&&tf3B£t£1»-A;*.— 10 
ABfcii LT-(&ffli-*t<73-?fc*. *^V7v®^ 
ggT-l*, rht> 3il 9 OifA*— ^SSW p *><mvf 

*v*. 

[0041] l*»lt, =7-?m&.£f&mm.-v\*-n, 

frfeftVOT?, 0 7 (c) cojg^ihA^.— /USte^ 

AttiB*mt>fi< * 9 s -arotw^ 7 1 *>e>B 

Sfcoift*. 

[0 0 4 2] I6^f?/S 1 ltS'fl^^S 

#fc.6#Jtb*ffi3«:0 8 K^i-7 d 1 tft 

Mi"*. 

[0 0 4 3] ^•^s'T'S 2 lTll^l — 7V9WBtttAS2 
tW^ri^Jfri"*. -tbT, * (No) « 

it, i-^fc*,2t)c£A±£0t§:tt^7 l 3'7 p S 2 2»£iftA, 30 

jft3bi6»ffa»<r¥yBi-* (^7^3 2 3) . j£ 
5b**5*»liBtfeH±^J*:i-*^ > ha«+#JLolt£> 

##* (Yes) coirtl^SSr^TLT^'f Wi — 
^ (06) KM*-*, ^5/^5 2 3^^ (N 
o) Ot#«^7 1 3'7 , S 2 6«CiiA/T?-fe5^-— hfct-Jfc.ft 
tttbtoSSrjm L^^fV (06) KM*. 
[0 0 4 4] ?fy7'S2 lT/^yftmfflS 

a^feT-fcSfcfiJtSJrSftfcttli^s/t/S 2 4 Kit 40 

tt*^idtt!l*»ff*»ar*IBf* (^fy7'S2 5) . i"& 

j/7'S2 5«fj)5^ (Yes) <Dt #ttM3£J&T L 
T^I'V/'W— ^> (06) ^^S25 
ro«;4*gj£ (No) <Oi:$ttXTS'7'S2 6\Z.T&A,V± 

5^— h^fettatitos^^L^ •< (0 

6) KM*. 

[004 5] 09li^f J//S22 (08) T2im£;h, 50 
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xnm'&it y k?ka**# £k y t'CX^H-cf 

^^.yw 4±<733E^B®K§i^£*U a-— 
Ba%BB«r gtSL&a* fe^ 6 &*&f£LTiEL^IEffi 
lit^xS. -ffcfe*,, 09 (a) \Z.7rrtSLb\^ if 
/U—7°\zm,-t2>±X<7)W&& 1 rJ 4 KS^£ 

H, -v£;*6£|&fELT^EPBK3*i-J;?K> &±<OW 
&k&T<DW&<D£:A <75^fitSSrAtv#^., 0 9 

(b) tcSWJ:*^ B^SriEL^ESlJ:M'<#^*. 
ft> rwtf, B&*rM^;lfcitKB&ro~&B#* 
■< > K*>*»fe tt^dU *»-&l2 * W > H £ K A 9 # * J: 5 
liSS 'J U--C X£*vc-r w 4 _htf)gE;5*BffiK* 
5*£;h.*. 

[004 6] 010 liH^IE^— h#j£.6tfcai*Q : 3g(7}#yS 
^ISr^i-7n— b-Cfo*. 
[0047] ^Ty7"S3 1 Tli^— riS&T/^fclg 

-ifei-s^.^:^^.oit*fc«)<;:*—^i-5tSisEs -Tft 
to*.-^ s>^>^SSH£fS:j£i-*. 
[0 0 4 8] 01 1 lifeM^t^iS-feiwR^^-^ y^-^ 
jy«BBK3£«:^i-0T?fooT, /<; i ?-?W&bL.xmt 

%, ^5 0%^— ><— M.-offi3rfa<D-m 

*^/J^H»40 11 ( a ) <0®JH£C £ 9 , *w<— 7 
s/T'i-SS^dSgBl^l 1 (b) <73^Dt^*. -tb 
T, 011 (a) «0€9®CF*3«SJwfc*.^P«iji!t^i-*.^ 
tt, 011 (b) ro^Ff*3ffl5»w#^-T*r iri:**. 
i-Ji F ^-^ffiiiS t *. 

[0 0 4 9] ro«t^{^y^>^i60Sr|g^b7>imx 
il0^fs'7 , S33 KiiA/T-^.fettai*fTMaSr 

X 9 #v ^*4S*»*r«Bi-«, MlS^* s MttN«TW t 

tfiMLT^-rv/W— (06) KM*. 
[0050] Hl2li^?y^S24 (0 8) -C^f$ 
tv* h^.^ttttitoSWtea^lilISr^i-^ n — 

^■r— h-cfc*. 

[0 0 5 1] ^ry/S 4 1T-IA01 OiO^ryT'S 3 

B^tfc^tt 2 tfcT-fo* <ot, b^*fic®ia^li0 1 
3»^t«t5l^ ±T (a) , T± (b) , fe* 

(c) , (d) 04iS9-Cfc*. -?rrX% rcD4il 



(7) 
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-Ttit>1b, ^fy/S4 2T?ttBifcttfl»«±T (12 1 3 
(a) ) o**teo^T#tf^ttW3^*ya«tfyv\ ^ 

l3lHSi&g;» 5 T± (013 (b) ) <D&&\co\,->Xtt& 

.tm&mntQM&tt^ * s ry7s4 5x\tt<ou%m 

•5. $P>Ji^7 i S'7'S4 6-C«®^g*5£^ (HIl 3 
(c) ) »^fco^T»^tttiU3ltfT«ie*rfTV\ * io 
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* NOTICES * 

Japan Patent Office is not responsible for any damages caused by the use of this 
translation* 

1 . This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2 **** s h ows the word which can not be translated. 

3 . In the drawings, any words are not translated. 



CLAIMS 



(57) [Claim(s)] 

[Claim 1] A synthetic parameter calculation means to compute the synthetic parameter for 
compounding an image, It has a synthetic processing means to compound an image based on 
the synthetic parameter computed by this synthetic parameter calculation means. In the 
panorama image synthesizer unit which compounds two or more images which some images 
overlap, and acquires the image of one sheet The panorama image synthesizer unit 
characterized by having a separate independence activation means to have a storing means 
to store the synthetic parameter computed by said synthetic parameter calculation means, 
and to separate and perform said synthetic processing means and said synthetic parameter 
processing means at a different stage. 

[Claim 2] It is the panorama image synthesizer unit according to claim 1 characterized by 
performing said synthetic processing means at the time of image reconstruction while having 
image pick-up equipment and the information processor which incorporates the image data 
picturized with this image pick-up equipment and performing said synthetic parameter 
calculation means at the time of the image data incorporation by said information processor 
from said image pick-up equipment. 

[Claim 3] Said parametric synthesis means is a panorama image synthesizer unit according to 
claim 1 characterized by performing at the time of the image reconstruction according [ said 
synthetic processing means ] to image pick-up equipment when the image photography by 
image pick-up equipment is completed, while performing. 

[Claim 4] It is the panorama image synthesizer unit according to claim 1 characterized by 
performing said synthetic processing means when outputting a panorama image to an 
external device from image pick-up equipment while said parametric synthesis means is 
performed, when the image photography by image pick-up equipment is completed. 
[Claim 5] Said external device is a panorama image synthesizer unit according to claim 4 
characterized by being an information processor. 

[Claim 6] In the creation approach of the panorama image which compounds two or more 
images which some images overlap, and acquires the image of one sheet After computing the 
synthetic parameter for creating a panorama image based on the corresponding points which 
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correspond mutually [ said two or more images ], The creation approach of the panorama 
image characterized by memorizing this synthetic parameter, performing synthetic 
processing of an image at a different stage from the calculation stage of said synthetic 
parameter based on said memorized synthetic parameter, and creating a panorama image. 
[Claim 7] The creation approach of the panorama image according to claim 6 characterized 
by performing synthetic processing of said image at the time of image reconstruction while 
performing calculation of said synthetic parameter at the time of the image data 
incorporation by said information processor from said image pick-up equipment, when 
transmitting the picturized image data for panorama images to an information processor from 
image pick-up equipment. 

[Claim 8] The creation approach of the panorama image according to claim 6 characterized 
by performing synthetic processing of an image at the time of the image reconstruction by 
image pick-up equipment while computing said synthetic parameter at the time of termination 
of the image photography by image pick-up equipment. 

[Claim 9] The creation approach of the panorama image according to claim 6 characterized 
by performing synthetic processing of an image at the time of the panorama image output 
from image pick-up equipment to an external device while computing said synthetic 
parameter at the time of termination of the image photography by image pick-up equipment. 
[Claim 10] Said external device is the creation approach of the panorama image according to 
claim 9 characterized by being an information processor. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the creation approach of a panorama image 
synthesizer unit and a panorama image that two or more images which some images overlap 
can be compounded, and the image of one sheet can be obtained from the image picturized with 
image pick-up equipments, such as an electronic camera, in more detail about the creation 
approach of a panorama image synthesizer unit and a panorama image. 
[0002] 

[Description of the Prior Art] Development of the panorama image composition technique 
which can compound two or more images which some images overlap is briskly performed in 
order to photo a wide image in recent years and to meet the demand of wanting to make it the 
image of one sheet. 

[0003] It not only says that a panorama image composition technique photos a wide image, but 
in the electronic camera, indication that resolution is low as compared with a film-based 
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camera or a scanner is especially made from the little of the number of pixels, and it is 
becoming important also as a means to photo a high resolution image, for the image photoed 
with this electronic camera. 

[0004] That is, power is demonstrated for it to be wide and take t this panorama image 
composition technique divides the manuscript of one sheet, a magazine, etc. into plurality, and 
photos them, and / acquire about the same high resolution data as a scanner, or / divide scenery 
into plurality, ] a photograph to high resolution. 

[0005] The conventional panorama image synthesizer unit using the above-mentioned 
panorama image composition technique A corresponding-points extract means to find the 
corresponding points which are the overlap locations of the image to compound, A synthetic 
parameter calculation means to compute the parameter for compounding an image from said 
corresponding points, It has the synthetic processing means which compounds two or more 
images based on the parameter computed by this synthetic parameter calculation means, and 
is used as the image of one sheet, and these above-mentioned means is performed when 
downloading an image from an electronic camera to a computer. That is, when a photograph is 
taken with an electronic camera, the attribute data of image data and this image data is stored 
in the memory built in the electronic camera. Moreover, in photoing a panorama image, in case 
a photograph is taken, it takes a photograph by setting an electronic camera to panorama 
image photography mode. By this panorama image photography mode, the identifier which 
shows an one-set panorama image is automatically recorded into the attribute data of the 
photoed image. And in case the image data and attribute data which are stored in the memory 
which connected the electronic camera to the computer and was built in the electronic camera 
are registered into the database inside a computer etc., said attribute data is checked through 
application software. Subsequently, from that to which the identifier in panorama image 
photography mode exists in attribute data, an one-set image is extracted automatically and 
panorama image composition is performed. That is, sequential execution of said 
corresponding-points extract means, said synthetic parameter calculation means, and said 
synthetic processing means is carried out, and panorama image composition is performed. 
[0006] 

[Problem(s) to be Solved by the Invention] However, in the above-mentioned conventional 
panorama image synthesizer unit, there was a trouble that there will be much each throughput 
of said corresponding-points extract means, said synthetic parameter calculation means, and 
said synthetic means, and the processing time will become long. That is, in the conventional 
panorama image synthesizer unit, since each the processings of all mentioned above were 
performed at the time of taking in by the computer, when panorama image data was included 
in image data, there was a trouble that a series of processings in which download an image 
from an electronic camera to a computer, and the image concerned is registered into a database 
etc. took long duration. 
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[0007] This invention is made in view of such a trouble, and it aims at offering the creation 
approach of a panorama image synthesizer unit and a panorama image that a panorama image 
processing can be performed in a short time. 
[0008] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose invention 
according to claim 1 among this inventions A synthetic parameter calculation means to 
compute the synthetic parameter for compounding an image, It has a synthetic processing 
means to compound an image based on the synthetic parameter computed by this synthetic 
parameter calculation means. In the panorama image synthesizer unit which compounds two 
or more images which some images overlap, and acquires the image of one sheet It has a 
storing means to store the synthetic parameter computed by said synthetic parameter 
calculation means, and is characterized by having a separate independence activation means to 
separate and perform said synthetic processing means and said synthetic parameter processing 
means at a different stage. 

[0009] Moreover, while invention according to claim 2 has image pick-up equipment and the 
information processor which incorporates the image data picturized with this image pick-up 
equipment in invention according to claim 1 and said synthetic parameter calculation means is 
performed at the time of the image data incorporation by said information processor from said 
image pick-up equipment, it is characterized by performing said synthetic processing means at 
the time of image reconstruction. 

[00 10] Furthermore, in invention according to claim 1, invention according to claim 3 is 
characterized by performing said synthetic processing means at the time of the image 
reconstruction by image pick-up equipment while said parametric synthesis means is 
performed, when the image photography by image pick-up equipment is completed. 
[00 11] Moreover, when image photography according [ on invention according to claim 1 and / 
said parametric synthesis means ] to image pick-up equipment in invention according to claim 
4 is completed, while performing, it is characterized by performing said synthetic processing 
means, when outputting a panorama image to an external device from image pick-up 
equipment, and invention according to claim 5 is characterized by said external device being an 
information processor in invention according to claim 4. 

[0012] Moreover, invention according to claim 6 is set to the creation approach of the panorama 
image which compounds two or more images which some images overlap, and acquires the 
image of one sheet. After computing the synthetic parameter for creating a panorama image 
based on the corresponding points which correspond mutually [ said two or more images ], This 
synthetic parameter is memorized, synthetic processing of an image is performed at a different 
stage from the calculation stage of said synthetic parameter based on said memorized synthetic 
parameter, and it is characterized by creating a panorama image. 

[0013] Moreover, in invention according to claim 6, when transmitting the picturized image 
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data for panorama images to an information processor from image pick-up equipment, while 
invention according to claim 7 performs calculation of said synthetic parameter at the time of 
the image data incorporation by said information processor from said image pick-up equipment, 
it is characterized by performing synthetic processing of said image at the time of image 
reconstruction. 

[0014] Furthermore, in invention according to claim 6, while invention according to claim 8 
computes said synthetic parameter at the time of termination of the image photography by 
image pick-up equipment, it is characterized by performing synthetic processing of an image at 
the time of the image reconstruction by image pick-up equipment. 

[0015] Moreover, while invention according to claim 9 computes said synthetic parameter in 
invention according to claim 6 at the time of termination of the image photography by image 
pick-up equipment, it is characterized by performing synthetic processing of an image at the 
time of the panorama image output from image pick-up equipment to an external device, and 
invention according to claim 10 is characterized by said external device being an information 
processor in invention according to claim 9. 
[0016] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained 
based on a drawing. 

[0017] Drawing 1 is the whole block diagram showing the gestalt of 1 operation of the 
panorama image synthesizer unit concerning this invention, and the electronic camera 1 as 
image pick-up equipment is connected to the personal computer (henceforth a "personal 
computer") 2 through the interconnection cable 3. Furthermore, a personal computer 2 has the 
mouse 6 as the display 4 which displays image data etc., and a pointing device equipped with 
the mouse button 5, a keyboard 7, and the system control section 8 that controls each [ these ] 
component, and the hard disk (HD) 9 as external storage is further connected to the system 
control section 8. 

[0018] Drawing 2 is the system configuration Fig. of a panorama image synthesizer unit, and 
the system control section 8 has a system memory (un-illustrating) and CPU (un-illustrating), 
operation system (henceforth "OS") 10 and an application program (it only abbreviates to 
"application" hereafter) 11 are stored in a system memory, and these OS's 10 and application 11 
are loaded to CPU if needed, and are performed by this CPU. 

[0019] Specifically, OS 10 is equipped with the input device managerial system 12 which 
receives a user's various inputs, the drawing managerial system 13 which manages drawing 
displayed on a display 4, and the file system 14 which controls I/O of a file. 

[0020] Moreover, application 11 is equipped with the image data management system 15 and 
the panorama image composition system 16. 

[0021] Specifically, the image data management system 15 is equipped with a data control 
means 17 to manage the keyword by attribute data and the user input of image data etc., and 
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the data display means 18 for searching image data with these attribute data, a keyword, etc., 
and displaying on a display 4. Moreover, the panorama image composition system 16 is 
equipped with a corresponding-points extract means 19 to extract the corresponding points 
between two or more image data, a synthetic parameter calculation means 20 to compute the 
synthetic parameter for compounding an image based on said corresponding points, and an 
image composition means 21 to compound two or more image data based on said synthetic 
parameter, and to acquire the panorama image of one sheet. 

[0022] Image data is delivered [ the input device managerial system 12 of OS 10 / through a 
keyboard interface 22 / through reception or the mouse interface 23 ] the input from a keyboard 
7 in this panorama image synthesizer unit and received for the input from a mouse 6 between 
electronic cameras 1 through reception and the general interface 24 in which an image transfer 
at high speeds, such as a bidirectional parallel interface and a SCSI interface, is still more 
possible. Moreover, the panorama image system 16 receives the image photoed in panoramic 
exposure mode from the image data management system 15, and performs a panorama image 
processing. Furthermore, the image data as a synthetic result compounded with the synthetic 
parameter obtained with the synthetic parameter calculation means 20 of the panorama image 
system 16 or the image composition means 21 is registered into the image data management 
system 15. And the image data registered into the image data management system 15 is sent to 
the drawing managerial system 13 of OS 10 through the data display means 18, and is 
displayed on a display 4 through the video interface 25. Moreover, it connects with a hard disk 
9 through the disk input/output (I/O) interface 26, and a file system 14 performs R/W of the 
files and image data which are physically stored in a hard disk 9, and performs transfer of 
these files and image data between the image data management systems 15 of application 11. 
[0023] Drawing 3 is drawing showing the DS of the image data stored in the internal memory of 
an electronic camera 1, and attribute data. 

[0024] That is, the image managed table 27 as shown in drawing 3 (a) is built in this internal 
memory, and the image data 28 and attribute data 29 corresponding to the image number of a 
photography image in this image managed table 27 are stored like image data 28b and 
attribute data 29b to image data 28a, attribute data 29a, and image No.2 to image No.l. 
[0025] image data 28 the original format data (henceforth "native data") of an electronic 
camera 1 - or either of the general-purpose format data, such as JPEG (Joint Photographic 
Coding Experts Group), is stored. It is data which native data only changed the output signal 
(analog signal) from CCD as an image sensor into the digital signal, and were obtained. It has 
the special feature that the time amount which record takes although data size is generally 
large is short. On the other hand, although the time amount which record takes JPEG data is 
long, it has the special feature that data size can be made small, for example, and the user who 
is a photography person chooses desired format data suitably according to a photography 
situation, and stores image data. 
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[0026] Moreover, the file name 30 automatically given to attribute data 29 by the electronic 
camera 1 as shown in drawing 3 (b), The file type 31 which identifies other general-purpose 
formats of a native data format, TIFF (Tag Image File Format) which a JPEG data format or 
an electronic camera 1 supports, The photography time 32 on which a date and time of day 
when the shutter release (un-illustrating) of said electronic camera 1 is pushed through the 
calender and timer which were built in the electronic camera 1 are recorded, The photography 
mode 33 at the time of the photography chosen from two or more kinds of photography modes 
which an electronic camera 1 has is stored. And when the photography mode name stored in 
this photography mode 33 is in panoramic exposure mode, an identifier 34 is added as shown in 
drawing 3 (c). That is, the mode identifier (henceforth "Mode ID") 35 to which this identifier 34 
is given when an electronic camera 1 is set to panoramic exposure mode, and the photography 
number 36 photography with this mode ID 35 indicates it to be the how many sheets they are 
are stored. Therefore, it will be said that two or more images which have the same mode ID 35 
in panoramic exposure mode are one set. That is, when "the scenery of a crest" is photoed as an 
image of two right and left in panoramic exposure mode like the image data shown in drawing 
3 , mode ID35of mode ID35a and image data 28b of image data 28a b has the same ID, and will 
constitute an one-set panorama image by these same ID. Thus, image data and its attribute 
data are stored in the internal memory of an electronic camera 1. 

[0027] Drawing 4 is the display screen on the display 4 in which the situation when copying or 
moving the image data and attribute data which were stored in the internal memory of an 
electronic camera 1 to the interior of a personal computer 2 is shown. 

[0028] That is, if an electronic camera 1 is connected to a personal computer 2 through an 
interconnection cable 3, the system control section 8 will start the image data management 
system 15, and will display the 1st window (henceforth a "camera catalog") 37 which displays 
the data built in the electronic camera 1, and the 2nd window (henceforth a "user catalog") 38 
which can display the image database stored in the hard disk 9 on a display 4. 
[0029] A deer is carried out and two or more display frames 39 which display a selection image 
for a copy etc. to use image data as a personal computer 2 on the camera catalog 37 are formed. 
Inside each display frame 39 The thumbnail image display section 40 which displays the 
contraction image (this contraction image is hereafter called "thumbnail image") of image data, 
The attribute data display section 41 is formed and the thumbnail image and attribute data 29 
of image data 28 which were built in the electronic camera 1 are displayed in the 
predetermined display frame 39. In addition, as for whether a part or all is displayed on the 
attribute data display section 41 among the attribute data stored in the internal memory of an 
electronic camera 1, the user is freely made selectable. That is, it can choose freely whether a 
user displays only a file name and a file type on the attribute data display section 41 among 
attribute data, or all the attribute data stored in said internal memory is displayed on the 
attribute data display section 41, and it can be displayed. 
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[0030] Subsequently, a mouse 6 is operated, and a user chooses the display frame 39, and as 
shown in an arrow head A, he copies or moves the selected image onto a user catalog 38. In 
addition, it can be switched by a user's free selection whether it copies (in this case, data are 
saved as it is at the internal memory of an electronic camera l) or it moves (in this case, the 
data which moved are eliminated from said internal memory). And native data are changed 
into predetermined general-purpose format data when downloading the image data stored in 
under [ 1 ] actuation of this copy (or migration) (i.e., an electronic camera) with the gestalt of 
this operation to a personal computer 2. When a photograph is taken in panoramic exposure 
mode, according to a photography image, corresponding-points extract processing and synthetic 
parameter calculation processing are performed, and the panorama image compounded by 
performing image composition processing after that at the time of image reconstruction is 
displayed on a display 4. 

[0031] Hereafter, these processings are explained concretely. 

[0032] Drawing 5 is drawing showing the DS on the above-mentioned user catalog 38, and this 
user catalog 38 is managed by the image data management system 15. The image data 
management system 15 has the user catalog 38 of the request number, and, specifically, has 
the catalog table 42 about each of a user catalog 38. Moreover, the catalog table 42 has the 
function in which a user divides two or more images for the image data in said user catalog 38 
for every category as one group, and, thereby, is hierarchizing and carrying out data control of 
the interior of one catalog table 42. The data identifier (data ID) 43 of the image data to which 
the catalog concerned belongs, and the group identification descriptor (group ID) 44 which 
identifies the group to whom the catalog concerned belongs are stored, and, specifically, group 
ID 44 links the catalog table 42 with the group attribute table 45. As for the group attribute 
table 45, the group attribute data 47 besides [ groups involved ] the data ID 46 of image data 
with which it belongs are stored. The group name 48 which the user gave to arbitration as 
group attribute data 47, the date and time of creation 49 by which the group was created, and a 
group type 50 are stored. As a group name 48, when a group is created as a set of a panorama 
image, it is given with a "panorama image" by the default. Moreover, when a user creates a 
group type 50 and a group is created as "user creation" and a set of a panorama image, the 
name a "panorama image" is stored. And when this group type 50 is a "panorama image", an 
identifier is added further. That is, the synthetic parameter 52 obtained by the mode ID 51 in 
which this identifier 34 is attached when a "panorama image" is set to a group type 50, and 
synthetic parameter calculation processing mentioned later is stored. 

[0033] Furthermore, the data control table 53 is built in the image data management system 15, 
and the data ID 54 which are the identifier of the proper to image data are attached and stored 
in it. And in the case of a panorama image, each data ID 54 corresponds with each image No of 
the image data stored in the internal memory of an electronic camera 1, and attribute data. 
[0034] Drawing 6 is a flow chart which shows the procedure of a panorama image processing, 
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and this program is performed by CPU Ourrillustrating) of a personal computer 2, when image 
data is transmitted to a personal computer 2 from an electronic camera 1. 

[0035] At step Si, it judges whether data processing was completed. Since decision of step SI is 
denied (No) at first, it progresses to step S2 and attribute data incidental to image data and 
this image data is acquired. And the image data concerned judges based on the file type 31 of 
attribute data 29 for whether it is native data (step S3), when it is not native data, while 
progressing to step S5, at the time of native data, after changing these native data into the 
predetermined general-purpose format of JPEG data etc., a file type 31 is updated, and it 
progresses to step S5. 

[0036] At step S5, it judges whether the photography mode 33 was investigated from the 
attribute data 29 stored in the data control table 53, and a photograph was taken in panoramic 
exposure mode. And when it is not a "panorama image", it registers as usual image data. That 
is, while attaching and registering the data ID 54 of a proper into the data control table 53, 
these data ID are registered into the catalog table 42 (step S6), and it returns to step Si. 
[0037] Moreover, at the time of a "panorama image", when the answer is affirmation (Yes), 
while the corresponding group for panorama images judges whether it is already created (step 
S7), and progressing to step S9, it progresses to step S9, after creating a group (step S8), when 
the answer is negation (No). That is, by confirming whether the mode ID 51 ( drawing 5 ) in the 
catalog table 42 and mode ID35a of an image managed table are the same, it judges whether it 
is finishing [ a group / creation ], and the new group ID 44 is registered into the catalog table 42 
at the time of un-creating, and it creates the group attribute 45 of a group name 48, the date 
and time of creation 49, and group type 50 grade. And it is recorded on a group type 50 as a 
"panorama image" in this case, and the same ID as the mode ID 35 in image data is stored in 
the mode ID 51. And in step S9, the data ID 54 of a proper are given to panorama image data, it 
registers with a data management system 53, the same data ID as these data ID are registered 
into the data ID 46 of the group attribute table 45, and it returns to step Si. 
[0038] When it carries out about all the image data to which a copy etc. carries out a series of 
above processings and processing is completed to all image data (i.e., when the answer of step 
Si is affirmed (Yes)) It judges whether although it progressed to step S10 and the copy etc. was 
carried out by current, the group of a panorama image was created from inside. When the 
answer is negation (No), while ending processing as it is, sequential execution of the 
corresponding-points extract processing (step Sll) and the synthetic parameter calculation 
processing (step S12) which are later mentioned using the image in a group when the answer is 
affirmation (Yes) is carried out. Subsequently, a thumbnail image is created and processing 
(step S13) is ended. 

[0039] Drawing 7 (a) - (c) is drawing showing the thumbnail format chosen by the 
above-mentioned thumbnail creation processing. 

[0040] Drawing 7 (a) is only for indicating that it is a panorama image, and the image 
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beforehand set as the system is used. Drawing 7 (b) contracts as it is, and displays the image 
contained in the one-set group for panorama images (henceforth a "panorama group"). Drawing 
7 (c) uses the image after composition as a thumbnail image. In this panorama image 
synthesizer unit, it is chosen by the user whether it creates in which thumbnail format of these 
three kinds of thumbnail formats. 

[0041] Since synthetic processing is not performed in case a deer is carried out and image data 
is incorporated from an electronic camera 1 in this panorama image synthesizer unit, the 
corresponding-points extract processing and the synthetic parameter calculation processing 
which reduce two or more images which constitute a panorama group in order to create the 
thumbnail image of the format of drawing 7 (c), and are later mentioned to two or more 
these -reduced images are performed, and synthetic processing is performed after that. In this 
case, since the target image is small, the processing time also becomes short and the effect on 
the time amount which the processing which reads image data from a series of electronic 
cameras 1 takes will become small. 

[0042] Next, it explains based on the flow chart which shows the corresponding-points extract 
processing performed at step Sll of drawing 6 to drawing 8 . 

[0043] At step S21, the image in a group judges whether they are two sheets. And when the 
answer is negation (No) (i.e., when it is two or more sheets), it progresses to step S22 and auto 
corresponding-points extract processing is performed, and subsequently the result judges 
whether it is a success (step S23). Here, it judges by whether the point with which, as for 
whether it is a success, images correspond was found enough. And when the answer of step S23 
is affirmation (Yes), while ending processing and returning to a main routine ( drawing 6 ), 
when the answer of step S23 is negation (No), it progresses to step S26, semi auto 
corresponding-points extract processing is performed, and it returns to a main routine 
( drawing 6 ). 

[0044] On the other hand, when the image in a group is judged to be two sheets at step S21, it 
progresses to step S24, and full auto corresponding-points extract processing is performed, and, 
subsequently the result judges whether it is a success (step S25). That is, it judges whether the 
point with which images correspond was enough found like step S23 mentioned above, and 
when the answer of step S25 is affirmation (Yes), while ending processing and returning to a 
main routine ( drawing 6 ), when the answer of step S25 is negation (No), it progresses to step 
S26, semi auto corresponding-points extract processing is performed, and it returns to a main 
routine ( drawing 6 ). 

[0045] Drawing 9 is drawing showing the user interface of the auto corresponding-points 
extract processing performed at step S22 ( drawing 8 ), and all the images belonging to the 
group of the panorama image concerned are resized by the magnitude included in a window, 
and it is displayed on the display screen on a display 4, and viewing this display screen, a user 
operates a mouse 6 and rearranges into right arrangement. That is, as all the images belonging 
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to a group are displayed on a display 4, a mouse 6 is operated and it is shown in an arrow head 
B, each display position of an upper left image and a lower right image is replaced, and as 
shown in drawing 9 (a), an image is rearranged into right arrangement as shown in drawing 9 
(b). In addition, at this time, when an image is rearranged and some images overflow a window, 
as it has gone into the window, it is resized again and displayed on the display screen on a 
display 4. 

[0046] Drawing 10 is a flow chart which shows the procedure of said auto corresponding-points 
extract processing. 

[0047] At step S31, the physical relationship of two or more images which the user rearranged 
is acquired, and the field searched in order to find corresponding points in agreement, i.e., the 
matching range, is set up in continuing step S32. 

[0048] Drawing 11 is drawing showing the matching entry between a left image and a right 
image, and the maximum range which the minimum range to overlap serves as the field C of 
drawing 11 (a), and overlaps a longitudinal direction when it acts as Ore Per Rapp a maximum 
of 50% a minimum of 10% and a gap of a lengthwise direction is defined to 5% or less, 
respectively serves as the field D of drawing 11 (b) beforehand as a regulation when taking a 
photograph as a panorama image, for example. And the point corresponding to the point P in 
the interior of field C of drawing 11 (a) will exist in the interior of field F of drawing 11 (b). That 
is, Field F turns into search space. 

[0049] Thus, after setting up the matching range, it progresses to step S33 of drawing 10 , 
corresponding-points extract executive operation is performed, the corresponding points 
mutually matched to search space F are searched, and then it judges whether there are more 
corresponding points than the predetermined value N at step S34. When corresponding points 
are below the predetermined values N, it judges that corresponding points were not found 
enough, namely, an extract result judges it as failure, and it moves to semi auto 
corresponding-points extract processing (step S25). On the other hand, when corresponding 
points are beyond the predetermined values N, corresponding points are found enough, and it 
judges that an extract result is a success, and returns to a main routine ( drawing 6 ). 
[0050] Drawing 12 is a flow chart which shows the procedure of the full auto 
corresponding-points extract processing performed at step S24 ( drawing 8 ). 
[0051] At step S41, the matching range is set up by the same technique as step S32 of drawing 
10 , and, subsequently four corresponding-points extract executive operation is performed. 
Since there is two image number of sheets in the case of full auto, the physical relationship 
considered is four kinds of (b), right and left (c), and right and left (d) on the upper and lower 
sides (a) and the bottom, as shown in drawing 13 . Then, corresponding-points extract executive 
operation is performed about these four kinds of cases, and the number and average 
coincidence level which have been extracted as corresponding points, respectively are held. 
That is, at step S42, corresponding-points extract executive operation is performed about the 
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case where an image location is the upper and lower sides ( drawing 13 (a)), and the number 
and average coincidence level which were extracted as corresponding points as a result are held 
in step S43. Subsequently, at step S44, corresponding-points extract executive operation is 
performed about the case where an image location is on the bottom ( drawing 13 (b)), and the 
number and average coincidence level which were extracted as corresponding points as a result 
are held in step S45. Furthermore, at step S46, corresponding-points extract executive 
operation is performed about the case where an image location is right and left ( drawing 13 (c)), 
and the number and average coincidence level which were extracted as corresponding points as 
a result are held by step S47. At continuing step S48, corresponding-points extract executive 
operation is performed about the case where an image location is right and left ( drawing 13 (d)), 
and the number and average coincidence level which were extracted as corresponding points as 
a result are held in step S49. And when it judges whether the thing beyond the predetermined 
value N has corresponding points by the processing result of the above-mentioned step S42 - 
step S49 (step S50) and corresponding points do not have [ the thing beyond the predetermined 
value N ] one, it is the case where corresponding points are not found enough, and an extract 
result judges it as failure and moves to semi auto corresponding-points extract processing (step 
S25). On the other hand, when the thing beyond the predetermined value N has corresponding 
points, it judges that the highest thing of average coincidence level is in the physical 
relationship of right truth, it is chosen from the inside, processing is ended, and it returns to a 
main routine ( drawing 6 ). Although it should become only one of the four above-mentioned 
kinds of image locations by the usual image when corresponding points are beyond the 
predetermined values N For example, there is a possibility of extracting beyond the 
predetermined value N as corresponding points even when a manuscript is divided and photoed 
and it is in the physical relationship which is not right since the similar alphabetic character is 
located in a line. He is trying to choose what was most suitable at step S51, i.e., the thing in the 
highest image physical relationship of average coincidence level, with the gestalt of this 
operation. 

[0052] Drawing 14 be drawing show the user interface in the semi auto corresponding points 
extract processing perform at step S25 of drawing 8 , and all the images belonging to the group 
of a panorama image be resize by the magnitude included in a window , and it be display on the 
display screen on a display 4 , and view this display screen , a user operate a mouse 6 based on 
location data , and pile up a general overlap location . The part piled up mutually displays by 
performing an AND operation for every bit per pixel. Thereby, both images are transparent and 
the piled-up superposition part comes to be visible. That is, in the gestalt of this operation, 
since a superposition part is transparent with said AND operation and it is visible during 
actuation of a mouse 6, general alignment can be performed easily. In addition, as it has gone 
into the window, it is again resized also at this time and it is displayed on the display screen on 
a display 4. [ as well as the case of auto corresponding-points extract processing ( drawing 9 ) ] 
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[0053] Drawing 15 is a flow chart which shows the procedure of said semi auto 
corresponding-points extract processing. 

[0054] The physical relationship of two or more images which the user rearranged at step S61 
is acquired, and the matching range is set up at continuing step S62. Since the matching range 
in this case serves as the error range of a superposition part and the margin which were 
assumed by the user, it becomes smaller than the range at the time of auto 
corresponding-points extract processing, and can aim at compaction of computation time, and 
improvement in precision compared with the time of auto corresponding-points extract 
processing. And at continuing step S63, corresponding-points extract executive operation is 
performed and it returns to a main routine ( drawing 6 ). 

[0055] Drawing 16 is the conceptual diagram of the corresponding-points extract executive 
operation performed at step S33 of drawing 10 , step S42 of drawing 12 , step S44, step S46, 
step S48, and step S63 of drawing 15 , and shows the case where corresponding points are 
extracted about the image (a left image and right image) of two sheets. 

[0056] First, it is set as a lengthwise direction, and as shown in drawing 16 (a), into a left image, 
it is set as a lengthwise direction 90%, and 10% of field C is set as a longitudinal direction by 
the matching entry mentioned above, and as for the range to search, 50% of field D is set up in 
the longitudinal direction 100% into the right image in the range in which corresponding points 
may exist. Subsequently, the point P (x y) that an edge is strong beyond the predetermined 
value M is looked for out of Field C, and length and the rectangle of each **n pixels wide are 
started as a template image I focusing on this edge. And this template image I is placed on 
search space F of a right image, and the difference is computed per pixel. And said difference 
computes the part used as the minimum value by shifting 1 pixel at a time on search space F. 
And as a result of searching all the interior of search space F, point P 1 (x\ yO which the 
minimum value becomes below the predetermined value L is held as corresponding points of 
Point P (x y). In addition, when extracting corresponding points about the image of two or more 
sheets, corresponding points can be extracted by repeating the processing mentioned above for 
the image of two sheets. 

[0057] Drawing 17 is a flow chart which shows the procedure of the corresponding-points 
executive operation mentioned above. 

[0058] An edge extract image will be created at step S71, an edge looks for the point P beyond 
the predetermined value M (x y) at step S72, if the point of having an edge beyond the 
predetermined value M is found, it will progress to step S73 and length and the rectangle of 
each **n pixels wide will be started as a template image I from Point P (x y). And based on the 
location of this point P (x y), search space F is set up in a right image (step S74). And the 
absolute value of the difference of a pixel value is computed for the image of search space F, and 
the template image I per superposition and pixel, and the total value is computed (step S75). At 
continuing step S76, the total value of difference is compared with the total value to last time, 
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and it judges whether it is the minimum value till then. And when the answer is negation (No), 
while progressing to step S78, it progresses to step S78, after holding the coordinate location of 
the minimum value and search space F concerned, when the answer is affirmation (Yes). At 
step S78, when the answer is negation (No), while judging whether all search space F was 
searched, and returning to step S75, when the answer searchs all affirmation (Yes), i.e., search 
space F, it progresses to step S79. and - thereby " difference - the point that a value serves as 
min and of being most in agreement will be detected. And at step S79, the minimum value of 
this difference judges whether it is a value small enough as compared with the predetermined 
value L. And when the minimum value is larger than the predetermined value Lj while 
progressing to step S81, when the minimum value is smaller than the predetermined value L, 
it judges that they are corresponding points mutually, and point P* (x\ y') used as the point P (x 
y) describing above and the minimum value and said minimum value are registered into a 
corresponding-points list (un-illustrating) (step S80), and it progresses to step S81. And these 
processings are performed about all the points of Field C, when it is judged that it all ended at 
step S81, it progresses to step S82 and the average value is computed from all the minimum 
values under corresponding-points list, this average value is held as coincidence level, and 
processing is ended. 

[0059] Next, the synthetic parameter calculation processing performed at step S12 of drawing 6 
is explained. 

[0060] When the image of two sheets is considered (since it becomes a repetition of the image of 
two sheets also in image composition of two or more sheets) if only the image of two sheets is 
considered, it will come out enough - ■ Point P (x y) and point P' (x\ y') which can express a gap 
of an image for each advancing side by side deltax and delta y of x directions and the direction 
of y, an angle of rotation theta, and a scale factor m, therefore correspond mutually are 
expressed like a formula (l). 
[0061] 

[Equation l] 



Here, A, B, C, and D are synthetic parameters. 

[0062] Since two or more sets of corresponding points (Point P (x y) and point P 1 Ox', yO) are 
acquired in the corresponding-points extract executive operation ( drawing 17 ) mentioned 
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above, the synthetic parameters A, B, C, and D are computed using a least square method. 
That is, the synthetic parameters A, B, C, and D which fill a formula (3) ■ a formula (6) so that a 
formula (2) may serve as the minimum value are computed. 
[0063] 

[Equation 2] 



Here, it is pi -p8. When a definition is given like a formula (7) * a formula (14), the synthetic 

parameters A, B, C, and D are expressed with formula (15) - (18). 

[0064] 

[Equation 3] 



[0065] 

[Equation 4] 
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That is, pi -p8 By substituting for a formula (15) - a formula (18), the synthetic parameters A, 
B, C, and D are computed, and it is stored in the synthetic parameter 52 of a group attribute 
table ( drawing 5 ). 

[0066] A deer is carried out, when the corresponding-points extract processing (step Sll) and 
the synthetic parameter calculation processing (step S12) which were mentioned above 
download from an electronic camera 1 to a personal computer 2 in this panorama image 
synthesizer unit, it performs, and synthetic processing of an image is performed at the time of 
playback actuation of image data, i.e., image reconstruction processing. 

[0067] Next, playback actuation of the image data registered into this equipment is explained. 
[0068] Drawing 18 shows the display screen when displaying the image data registered into the 
image data management system 15 on a display 4. 

[0069] That is, a window is displayed for every (user catalog 38a, user catalog 38b, ....) user 
catalog, and the attribute data 61 of the thumbnail image 60 and this thumbnail image 60 is 
expressed as the gestalt of this operation into this user catalog 38. In addition, it can be freely 
chosen and changed by user assignment whether a user displays only a file name and a file 
type among attribute data or all the attribute data that the thumbnail image 60 has is 
displayed. And a user can display the subject-copy image managed by the image data 
management system 15 on the tee spray 4 by operating the thumbnail image of the arbitration 
chosen from the thumbnail format (refer to drawing 7 ) mentioned above with a mouse 6 to 
display an image on the tee spray 4. 

[0070] Drawing 19 is a flow chart which shows the procedure of image reconstruction 
processing. 

[0071] It judges whether it is that to which the specified thumbnail image belongs to a 
panorama group, it judges that it is the usual image when the answer is negation (No), and an 
image is expressed as step S91 on a display 4 as it is. 

[0072] The answer of step S91 is affirmed (Yes), on the other hand, a thumbnail image 
progresses to a panorama group at step S92, a group, then when it is judged, and synthetic 



16/19 



[JP,3302236,B] 



processing is performed. That is, in this panorama image synthesizer unit, since only 
corresponding-points extract processing (step Sll of drawing 6 ) and synthetic parameter 
calculation processing (step S12 of drawing 6 ) are performed at the time of registration when 
managing a panorama image, it is necessary to perform synthetic processing to display a 
registered panorama image on a display 4. For this reason, it judges whether it is what the 
thumbnail format specified at step S91 expresses to, the group, i.e., the panorama group, for 
panorama images, and in the case of the thumbnail showing a panorama group, two or more 
images which perform synthetic processing at step S92, and belong to a panorama group are 
compounded, and it creates a panorama image. And in the case of the format thumbnail 
showing in drawing 7 (a) and (b) expressing a panorama group, at continuing step S93, the 
thumbnail image of a thumbnail format as shown in drawing 7 (c) is created. Subsequently, at 
continuing step S94, the panorama group who specified is deleted from the image data 
management system 15, the newly created panorama image is registered into the image data 
management system 15, this newly registered panorama image is expressed as step S95 on a 
display 4, and processing is ended. 

[0073] Next, the synthetic processing performed at step S92 is explained. 

[0074] Since the synthetic parameters A, B, C, and D are already computed at the time of 
registration and are stored in the catalog table 42 as mentioned above, it is computed by 
substituting these composition parameters A, B, C, and D for a formula (19). 
[0075] 

[Equation 5] 



And as shown in drawing 20 , when images are a left image ( drawing 20 (a)) and a right image 
( drawing 20 (b)), an image twice the magnitude of the right is secured as a synthetic image 
field K ( drawing 20 (c)). Here, a left image is first copied to the synthetic image field K as it is. 
Next, based on a formula (19), O' (x 1 , y f ) is computed about the residual field O of the synthetic 
image field K (x y), the pixel of O 1 (x\ y ! ) of a right image is copied to the residual field O (x y), 
and a synthetic image is created by performing these to all the fields of a synthetic image. 
[0076] Drawing 21 is a flow chart which shows the procedure of synthetic processing. At step 
S101, a twice as many field as the 1st image (left image) is secured as a synthetic image field K, 
and the 1st image is copied to the synthetic image field K on the same coordinate as it is at 
continuing step S102. Subsequently, at step S103, O' (x\ y f ) is computed based on a formula (19) 
about the residual field O of the synthetic image field K (x y). At continuing step S104, when it 
does not exist, while judging whether O 1 (x\ yO exists in the 2nd image (right image), and 
progressing to step S106, when it exists, the pixel of O f (x\ yO is copied to the residual field O (x 
y), and it progresses to step S106. And when it continues throughout the synthetic image field 
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K, the above processing is performed repeatedly and processing is completed, the answer of 
step S106 is affirmed (Yes), ends processing, and returns to a main routine ( drawing 19 ). 
Thereby, image composition can be performed using the registered synthetic parameters A, B, 
C, and D at the time of image reconstruction processing. 

[0077] In addition, this invention is not limited to the gestalt of the above-mentioned 
implementation, although synthetic processing is performed with the gestalt of the 
above-mentioned implementation when reproducing a panorama image the instruction in the 
time of the arbitration from an operator - or when a personal computer 2 will be in unloaded 
condition beyond fixed time amount, it is also desirable to perform synthetic processing to the 
panorama image data stored in the image data management system 15. 

[0078] Moreover, although an electronic camera 1 is connected to a personal computer 2 and 
the personal computer 2 side is performing a series of processings about a panorama image 
with the gestalt of the above-mentioned implementation, it is also possible to perform 
panorama composition processing of a top Norikazu ream with an electronic camera 1, and 
synthetic processing can be carried out when performing corresponding-points extract 
processing and parameter calculation processing when photography of the image which is 
needed in this case is completed, and carrying out data output. 
[0079] 

[Effect of the Invention] As explained in full detail above, according to the creation approach of 
the panorama image synthesizer unit of this invention, and a panorama image Since it can gain 
separate independence temporally and processing which computes a synthetic parameter, and 
processing which compounds an image using this synthetic parameter can be performed when 
creating a panorama image The processing time for creating a panorama image can be 
distributed, and it is effective in the time amount for transmitting image data to external 
devices, such as an information processor, from image pick-up equipment being reducible. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the whole block diagram showing the gestalt of 1 operation of the panorama 
image synthesizer unit concerning this invention. 

[Drawing 2] It is the system configuration Fig. of the above-mentioned panorama image 
composition processing. 

[Drawing 3] It is drawing showing the image managed table built in the electronic camera. 
[Drawing 4] It is the display screen of the display in which a situation in case a copy etc. 
makes the image data built in the electronic camera the interior of a personal computer is 
shown. 
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[Drawing 5] It is the data structure diagram of a user catalog. 

[Drawing 6] It is the flow chart which shows the manipulation routine of a panorama image 
processing. 

[Drawing 7] It is drawing showing the thumbnail format for panorama images. 

[Drawing 8] It is the flow chart which shows the procedure of corresponding-points extract 

processing. 

[Drawing 9] It is drawing showing the user interface of auto corresponding-points extract 
processing. 

[Drawing 10] It is the flow chart which shows the procedure of auto corresponding-points 
extract processing. 

[Drawing 1 1] It is drawing for explaining a setup of the matching range. 

[Drawing 12] It is the flow chart which shows the procedure of full auto corresponding-points 
extract processing. 

[Drawing 13] It is drawing showing the user interface of full auto corresponding-points 
extract processing. 

[Drawing 14] It is drawing showing the user interface of semi auto corresponding-points 
extract processing. 

[Drawing 15] It is the flow chart which shows the procedure of semi auto 
corresponding-points extract processing. 

[Drawing 1 6] It is the conceptual diagram of corresponding-points extract executive 
operation. 

[Drawing 17] It is the flow chart which shows the procedure of corresponding-points extract 
executive operation. 

[Drawing 18] It is the display screen when displaying the image data registered into the image 
data management system on a display. 

[Drawing 19] It is the flow chart which shows the procedure of image reconstruction 
processing. 

[Drawing 20] It is the conceptual diagram showing synthetic processing of an image. 
[Drawing 21] It is the flow chart which shows the procedure of synthetic processing. 
[Description of Notations] 

1 Electronic Camera 

2 Personal Computer 

1 5 Image Data Management System 

1 6 Panorama Image Composition System 

20 Synthetic Parameter Calculation Means 

21 Image Composition Means 



[Translation done.] 
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